Optimal stopping for measure-valued piecewise deterministic Markov processes
نویسندگان
چکیده
منابع مشابه
Numerical method for optimal stopping of piecewise deterministic Markov processes
We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location – inter-arrival time Markov chain naturally embedded in the PDMP, and path-adapted time discretization grids. It allows us to derive bounds for the convergence rate of the algorithm an...
متن کاملOptimal Stopping and Gittins' Indices for Piecewise Deterministic Evolution Processes
An optimal stopping problem involving a piecewise determinis-tic evolution processes is explicitly solved using the method of quasi-variational inequalities. The explicit solution derived ooer the possibility to explicitly discuss the associated dynamic allocation problems by means of the Gittins indices.
متن کاملNumerical methods for optimal control of piecewise deterministic Markov processes
Scientific Research context: In 1980, M.H.A. Davis [1] introduced in probability theory Piecewise Deterministic Markov Processes (PDMP) as a general class of models suitable for formulating optimization problems in queuing and inventory systems, maintenance-replacement models, investment scheduling and many other areas of operation research. In the continuous-time context, stochastic control th...
متن کاملOptimal Stopping Problems for Some Markov Processes
In this paper, we solve explicitly the optimal stopping problem with random discounting and an additive functional as cost of observations for a regular linear diffusion. We also extend the results to the class of one-sided regular Feller processes. This generalizes the result of Beibel and Lerche [Statist. Sinica 7 (1997) 93–108] and [Teor. Veroyatn. Primen. 45 (2000) 657–669] and Irles and Pa...
متن کاملOptimal Stopping Games for Markov Processes
where the horizon T (the upper bound for τ and σ above) may be either finite or infinite (it is assumed that G1(XT ) = G2(XT ) if T is finite and lim inft→∞G2(Xt) ≤ lim supt→∞G1(Xt) if T is infinite). If X is right-continuous, then the Stackelberg equilibrium holds, in the sense that V ∗(x) = V∗(x) for all x with V := V ∗ = V∗ defining a measurable function. If X is right-continuous and left-co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Applied Probability
سال: 2020
ISSN: 0021-9002,1475-6072
DOI: 10.1017/jpr.2020.18